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PsJ , Abstract 

Suppose that {X„, n > 0} is a stationary Markov chain and is a certain function on a 
phase space of the chain, caUed an observable. We say that the observable satisfies the central 
limit theorem (CLT) if y„ := N~^/'^ Y^n=Q ^{^n) converge in law to a normal random variable, 
as — > +00. For a stationary Markov chain with the LP' spectral gap the theorem holds for all 
V such that V{Xo) is centered and square integrable, see Gordin |7|. The purpose of this article 
is to characterize a family of observables V for which the CLT holds for a class of birth and death 
chains whose dynamics has no spectral gap, so that Gordin's result cannot be used and the result 
follows from an application of Kipnis-Varadhan theory, see [8] . 



1 Introduction 



^ . Suppose that {Xn, n > 0} is a stationary Markov chain defined over a probability space (O, P) and 

y is a certain function, called an observable, given over the phase of the chain such that '&V[Xq) = 
^sD ' and Ey^(Xo) < +oo. Here E is the mathematical expectation corresponding to P. We say that the 

chain satisfies the central limit theorem (CLT) if the random variables 



N 

g: y„:=Ar-V2^y(X„) (1) 

n=0 

converge in law to a normal random variable, as — t- +oo. Characterization of Markov chains and 
the class of observables for which the CLT holds, is one of the fundamental problems in probability 
^ . theory. One of the first results of this type has been the CLT proved by Doeblin [4J for chains whose 

^ \ transition probabilities satisfy what is now called Doeblin condition. For stationary Markov chains 

with the spectral gap the theorem has been proved by Gordin [7j. A remarkable result giving 
a complete characterization of reversible Markov chains, i.e. such that for any > the laws of 
{Xq,Xi . . . ,Xj\f) and of (A^v, -'^at-i, . . . ,^o) are identical, satisfying the CLT has been proved by 
Kipnis and Varadhan in their seminal article |8j, see also De Masi et al. [3j. It has been shown in 
[8] that the CLT holds for such chains if only V satisfies 



D^(V) := lim — E 



n=0 



< +00. (2) 



One can also prove, see [^, that the limit appearing in ^ always exists, being finite or infinite for 
any reversible chain. Sometimes, however, it is not easy to verify the condition directly. 

It can be shown that any ergodic and Markov chain with a finite phase space has a spectral 
gap, so the CLT is valid by an application of the Gordin's result. According to our knowledge, the 
examples of chains not having the spectral gap property, yet satisfying the theorem, concern the 
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situation when the phase space is uncountable, e.g. tagged particle in a simple exclusion process, 
random walks in random environments, diffusions in random media etc., see for instance [3l[9]. One 
of the latest review articles about CLT for tagged particles and diffusion in random environment is 
The objective of this paper is to show an application of the Kipnis-Varadhan theory in the 
perhaps simplest possible case (outside finite chains), namely to a reversible chain with a countable 
phase space but with no spectral gap (the Gordin's result cannot be used then). An example like 
this is furnished by a birth and death chain from Lamperti's problem (see the definition in Section 
[2]), whose phase space is the set of non- negative integers. In the situation considered in the present 
article we give also a necessary and sufficient explicit condition for an observable V so that ([2]) holds. 
The problem of CLT for the trajectory of the chain has been solved in Menshikov and Wade article 

m- 

As far as the structure of our paper is concerned, in the next section we will introduce some 
basic terms and present three theorems which are our main results. The remaining three sections 
deal with the proofs of these theorems. 

2 Preliminaries and statements of the main results 
2.1 Generalities 

Assume that {Xn, n > 0} is a Markov chain whose state space is Z+ = {0, 1,2,.. .}. It means that 
there exists a function p : Z+ x Z+ — t- [0, 1] such that p{x, y)dy = 1 for all x G Z+ and 

F[Xn+l = Xn+l\Xo = Xq, . . . ,Xn = Xn] = p(x„,X„+i). 

Here J^_^ f{x)a{dx) := f{x)a{x) for an arbitrary / : Z+ —5- M and a : Z+ —5- [0, +oo). We will 

write J^_^ f{x)dx when a{x) = x. Then 

Pf{x)= [ p{x,y)f{y)dy, ^ f e Bb{Z+) 
Jz+ 

is called a transition operator. Here Bb{7j^) denotes the space of all bounded functions on 
Suppose that vr : Z+ — (0, 1] is a strictly positive probability measure, i.e. J^^ Tr{x)dx = 1. It 
is assumed to be reversible and ergodic with respect to the chain. Ergodicity means that for any 
bounded / equality Pf = f implies that / is constant tt a.s. We say that the chain is irreducible 
if for any x,y £ Z+ exists n > 1 such that p'^{x,y) > 0, where p^{x,y) denotes the probability of 
going from x to y in n steps. 

Remark 2.1 It is well known (^, p. 338) that a stationary, irreducible Markov chain with a 
countable state space is ergodic. 

Reversibility, on the other hand, means that the detailed balance condition holds, i.e.: 

p{x, y)-K{x) = p{y, x)7r{y), Vx, y G Z+. (3) 

This condition is equivalent to the fact that P can be extended to a bounded and symmetric con- 
traction on -L^(vr) - the space of all / such that ||/||^ = /^^ f'^{x)ir{dx) < +00. In consequence the 
spectrum of P lies in [—1,1]. Note that Aq = 1 is the largest eigenvalue of P corresponding to an 
eigenfuction fo{x) = 1. Let 

Ai :=sup[(P/,/)^, / /(x)^(dx) = 0, ||/|U = 1]. (4) 
Jz+ 
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We say that the chain has the spectral gap property, when Ai < 1. Here (•, •)7r is the scalar product 
corresponding to || • \\t^. 

Now we will formulate our first main result. It is a simple criterion for continuity of the spectrum 

" (x) 

at 1. For any x G let us define Aq by 

A[,")=sup[(P/,/)^, fix) = 0,\\f\\^ = l]. (5) 

" (x) 

We note that Aq is the largest eigenvalue for the "reduced" operator P = HxP^x, where is the 
orthogonal projection onto the subspace Hjf '^ := [f G L'^{t^) '■ f{x) = 0]. 

Theorem 2.2 (A criterion for continuity of the spectrum at 1) 

Suppose that the chain n > 0} is reversible, irreducible and there exist x E for which 

Aq = 1. Then 1 is not an isolated point of the spectrum of the transition operator P. 

The proof of this theorem is presented in Section |3l 
2.2 Birth and death processes 

We recall the definition of a birth and death process (see [5], p. 295, Example 3.4.). In our setting 
it is a Markov chain on countable state space Z_|_ := {0, 1,2,...,} with the transition probabilities 
satisfying that p{x, y) = iff |x — y| 7^ 1. We also require that po := p{0, 1) = 1 and 

p{x,x + l)=px, p{x,x - I) = Qx, X >1, 

are all strictly positive. Of course we have Px + Qx = 1 for all x > 1. In this case there is the 
measure 7r(x) = YVk=iiPk-i/Qk) which is reversible and unique up to a multiplicative constant ([5] 
p. 301, Example 4.4). This measure is not necessarily finite. In fact [5J, p. 306, Theorem 4.5, it is 
infinite iff the chain is recurrent but not positive recurrent. In case it is positive recurrent we have 
Z := J"^_^ T\{x)dx < +00 ([5] p. 307, Theorem 4.7) and then it{x) := Z~^tt{x) is a unique invariant 
law of the chain. A reader can find more information about this class and more details about this 
chain in volume I of Feller's monography [6J. 

Our second goal is to find relation between transition probabilities and spectral gap property in 
the birth and death process. 

Theorem 2.3 Let {A„ , n > 0} be a birth and death process with transition probabilities as above. 
We have three possible situations then: 

(i) if\\mx^+ooPx = P, liiiix-^+oo ^a; = Q and p < q, then the chain is positive recurrent and has the 
spectral gap property, 

(a) if Px = 1/2 — Cx and Qx = 1/2 + Cx, where 

< c* = liminf CxX°' < limsupc^^x" = c* < +00, (6) 

x—>-co 3;— s-oo 

and a S (0, 1), then we have the positive recurrence but we do not have the spectral gap property, 
(Hi) if dni) holds but for a > 1, then the chain is recurrent but not positive recurrent. 

The proof of this result is presented in Section HI 

Remark 2.4 From section 1.12, p. 71-76 of [2J we know that, when a = 1 then both positive 
recurrence and null recurrence may occur. It depends on the constants c*, c*. 
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Remark 2.5 The above result can be interpreted as follows. If we have a strong drift to the left, 
i.e. the local drift ■= Px — Qx satisfies lim sup^.^^^ D^. < 0, then the chain is positive recurrent 
and has the spectral gap property. When we have a weaker drift to the left but Dx ~ —c/x", for 
some c > and a £ (0, 1), then the chain is positive recurrent but does not have the spectral gap. 
Finally, when we further increase the probability of going to the right so that Dx ~ — c/x", for a > 1 
and some c > 0, then the chain loses the property of the positive recurrence. 

The most interesting case of the previous theorem is part (ii). In this situation we wish to 
characterize the class of observables for which the random variables ([T]) satisfy the CLT The necessary 
and sufficient condition for this can be stated as follows. 

Theorem 2.6 Let V : Z+ — t- M 6e a zero-mean function in LP'{tt) and n > 0} is the chain 

from Theorem \2.3\ (ii). Then, Yn given by ^ satisfies ([2]) iff 



dx 
■k(x) 



V{y)7r{dy) 
0<y<x 



< oo. 



3 Proof of Theorem [23] 



In order to make our calculations easier, we change our space L'^{t^) into space i"^ corresponding to 
the counting measure on Z+ while (•, •), || • || denote the respective scalar product and the l"^ norm. 

We will introduce some terms which are useful throughout the proof. Let us denote by ^ = 
[a{x^y)\x^y^Zj^ a matrix with a{x,y) := iT^^'^{x)p{x,y)TT{y)^^/'^ . Note that the definition means that 
A = DPD~^, where D =diag[7ri/^(0), 7ri/^(l), . . .], i.e. the operators are unitary equivalent. In 
particular the above means that 



Ai =sup[(yl/,/); 



1, / e ^o] 



(7) 



Observe that A is a symmetric matrix. Moreover, for any / with ||/|| < 1 we have 



\{Af,f)\:- 



a{x,y)f{x)f{y)dxdy 



< 



< 



TT{x)p{x,y)-K ^{y)f{yfdxdy\ if [ p{x,y)f{xfdxdy\ 



< 1. 



7r^/^(x)p(x, y)iT{y) f{x)f{y)dxdy 

1/2 



The spectrum of A is also contained in [—1, 1], in fact because of the unitary equivalence, it coincides 
with the spectrum of P. Note that := (tt^^'^ (0) , n^^"^ (1) , . . .) is an eigenvector that corresponds to 
an eigenvalue Aq = 1. Denote by £q the space consisting of / S £^ such that {f,f*) = 0. 
Denote by A' matrix A' = UxAIlx- We can easily check that 



Af,")=supK^/,/); 



1, / G Hx], 



(8) 



where Hx := [f e f : f{x) = 0] and A^"^ in ^ is defined in _ 

If the supremum is attained at certain /(°), such that ||/(°)|| = 1, /(°) G Hx, then we would have 
to have ^/'•'^^ = f^'^^ and that would mean Pg^'^^ = g^^\ where g^'^^ = D~^f^^\ This, however, would 
imply g^^^ = cl for some constant c, or equivalently f^^^ = c[tt^^'^ (0) , ir^^"^ (1) , . . .]. Since f^^\x) = 
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we would have c = 0, which leads to a contradiction. The above means that 1 is not in the point 
spectrum of A' and since it does belong to the spectrum it must be in its continuous part. We show 
that the above implies that 

Ai = 1. (9) 
Suppose otherwise, i.e. Ai < 1. Indeed, suppose that G are such that \\f'-''^\\ = 1 and 

Denote by Q the orthogonal projection onto Iq. We have 

and ||Q/('')f = 1 - "2. Since {Af^^Qf""^) = we have from ^ 

l^(yl/("),/("))<a2+Ai(l-a2)^l. 
This implies — )• 1 and in consequence ||Q/(")|| 0. Suppose that a„ 1. This yields 

7rV2(a;)<||/(")-/,||^0, 

which is impossible. On the other hand, if a„ — t- — 1 we have 

7rV2(^)<||/W + /^||^0, 
which is again impossible. Hence the conclusion of the theorem follows. 

4 Proof of Theorem ESI 

We split our proof into two parts. The first one called, "strong drift to the left", considers the case 
(i) from Theorem 12.31 the second, "weaker drift to the left" deals with the cases (ii) and (iii) from 
the theorem. The main point is that in case (i), when the drift to the left is sufficiently strong the 
chain has a spectral gap. 

4.1 Strong drift to the left 

In this case we have VnHx^+ooPx = ^^^x^+oo Qx = Q and p < q. First, we check whether the chain 
is positive recurrent i.e. we verify that 



:= / 7r(x)(ia 



Tt(x)dx < OO, 

where 

X 

. . Pk-l 

TT - 



see Example 4.4, p. 301 of [5j. From assumption (i) we know that for all e > 0, exist > 0) such 
that for all k > kQ we have 

\pk-p\ < e A \qk - q\ <e. 

Now we can see that 

r r OO k OO /„ I p\fc-fco 

/ n{x)dx= / n{x)dx + n{ko) V TT ^<c V ^— ^ < oo 
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for some c > 0, provided that p + e < q — e. Hence in this case we know from [5j, p. 307, Theorem 
4.7 that we have a positive recurrence. 

Now we show the spectral gap property. From [1], see Theorem 1.5, p. 10 case 3, we have that 
Ai < 1 iff (5 < oo, where 



6 := sup / dy I [7r{y)py] ^ / vf(y)(iy \ . 

x>l J0<y<x-1 I Jx<y J 



Observe that 



k 



I TT{y)dy = tt{x) / dk T\ 

Jx<y Jx+l<k 1^ 

<^x) / (P±l\ dk<Cnix) 

Jx+l<k \Q - ^ J 

for some constant C > 0, provided that p + e < q — £. We can write then 

jr ^ C f TT{x)dy C f , rr Pi'-^ 
d < sup / ^ = sup / dy \\ 

P- £ x>iJo<y<x-i ^{y) P- £ x>iJo<y<x-i ^j--^^ Qk 

p-£ 1 - [p + £){q - er^ 
4.2 Weaker drift to the left 

Now we will be interested in the case when px = 1/2 — Cx, qx = 1/2 + Cx, where 

lim inf c^^x" = c,, > 0, 
limsupCa,x" = c* < oo. 

x—^oo 

SO we can find positive constants K, Di , D2 such that for all x > we have 

> Cx > . 

C0^~^ CO ^ 

We show that when a G (0, 1) then we do not have the spectral gap property but we have the 
positive recurrence. Also we show that when a > 1, we do not have the positive recurrence. Thus, 
a = 1 is a critical exponent where the chain loses the positive recurrence. 

It is easy to see that we can find some positive constant c for which p^-i/qk < 1 — c/k" for 
k > K. And for such c we have 

Hence, using the integral test for convergence we have 

X ^ 

7r{x) < exp { — — } < cexp(— cx"*^^"), x > K, 

k=l 

where c denotes a positive constant. From the comparison test we see that J^^ 7r{x)dx < +00 when 
a < 1 and the positive recurrence follows. 
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On the other hand we also have some positive constant c', for which pk-i/qt > 1 — c'/A;° for 
k > K. But when a > 1, we can easily check, using again the integral test for convergence, that 

7r(x) > cexp(-c"x^~"), x > K, 

where c, c" is another positive constant. Then Tr{x) fails the necessary condition for convergence of 
the respective series. 

Now we will show that we do not have the spectral gap property when a < 1. To do so we use 
Theorem 12.21 and show that 1 cannot be an isolated point of the spectrum. We choose x = in 
condition ([5]). Denote by A' a symmetric matrix obtained from A by crossing out the 0-th column 
and 0-th row. We prove that sup||j||=;^(^'/, /) = 1. Let /„ have ■nT^I'^ on the first n coordinates 
and the rest of them vanishes, i.e. /„ := [n~^/^, n~^/^, . . . , n"^''^, . . .]. A simple computation shows 
that 



a(x,x^ 1) = ,/pxqx+i 
a{x,x - 1) = ^ypx-lqx 

and 



^ + ci , X = 



^ + Ci , X = 1 



(^7n,/n)=2/ a{x,X + l)fn{x)fn{x + l)dx = - I 1 + 2Cx+l - 2Cx - CxCx+ldx. 

Let e > 0. Then, there exists iq such that for i > io 

|2cj+i - 2ci - CiCi+i\ < e. 

Hence, 

{A'fn, fn) > Vl - £, when re oo. 

Since e > was arbitrary we have Aq*^^ = 1 and, by Theorem 12.21 we do not have the spectral gap 
property. 



5 Proof of Theorem 12.61 

In this section we assume that the hypothesis of Theorem 12.31 part (ii) holds. We formulate a 
sufficient and necessary condition for an observable V so that ([2]) holds for random variables given 
by (P). 

We are going to use the result from [S], see (1.8) p. 3. According to that result the necessary 
and sufficient condition for the validity of ([2]) is that < oo, where 

\\V\\l,:= sup \2{V,v)^-{{I-P)ip,v)A. (10) 

In what follows we will find the maximizer of this supremum by solving the Euler-Lagrange equation 
(fT5]) . The maximizer belongs to a certain Hilbert space, that we denote by Tii, which is a bigger 
space than L^(7r). 
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Observe that we have a fohowing equality 

{{I -P)^,^)^ = \ j [ p{x,y){^{y)-ip{x) fdy7r{dx). (11) 

Denote the discrete gradient df{x) = /(x + 1) — f{x) and its dual, with respect to the scalar product 
from i'^, d* f{x) = f{x — 1) — /(x). It is easy to see that when the supp/ is compact then the 
following integration by parts formula holds 

df{x)g{x)dx= [ f{x)d*g{x)dx- f{0)g{0). 

Jx>l 



In our case we have 



^ + Cx ) ( d*ip{x) ] + { 7;-Cx]{ dip{x] 



7r{dx). 



Ix>l 

We can find some positive constants ci, C2, for which 

ciSoi^) <£{^) <C2£o{^), (12) 

where 

^o(v') := / {dip{x))'^7r{dx). 

Then, 

sup {2{V,v)^-C2£o{v)} <\\V\\l^< sup {2{V,ip)^-ci£o{^)}. (13) 

We can see therefore that < +oo iff the supremum of the functional ^{f) appearing on the 

right hand side of (I13p is finite. Since the functional <!>(•) is weakly upper semicontinuous on a 
Hilbert space 

Til := [if : £o{ip) < +oo], 
and lim||^||^^_^^oo <I>(99) = — oo, it attains its maximum 

= sup[4>(v3) : if £ L^(7r)] < +oo (14) 
and its maximizer has to satisfy the Euler-Lagrange equation, which in this case reads 

y(x)7r(x) = d*[n{x)dip,{x)], Vx > 1 (15) 
and V^(0) = —dip{0), or equivalently 

7r{x)dip{x) = —7r{x)V{x) + 7r(x — l)dip{x — 1), Vx > 1 
and dip{0) = —1^(0). Note that from this equation we get 



hence 



TT{x)dip{x) = - / V{y)TT{dy) + TT{0)dip{0) = - / Viy)7ridy), 



dip{x) = / V{y)Tr{dy), 



7r(x) 



0<y<x 
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The supremum in (fH|l equals 



[9^(x)]27r((ix) 



dx 
■k{x) 



V{y)7Tidy) 



0<y<x 



and the requh'ement that <I>* < +00 is the same requirement as ||l^||-i < +00, thus the conclusion 
of Theorem 12.61 follows. Note that the fact that <I>* < +00 in particular implies that 



VivMdy) = 0. 
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